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Abstract — We study the properties of Tsallis entropy and 
Shannon entropy from the point of view of algorithmic random- 
ness. In algorithmic information theory, there are two equivalent 
ways to define the program-size complexity K(s) of a given finite 
binary string s. In the standard way, K(s) is defined as the length 
of the shortest input string for the universal self -delimiting Turing 
machine to output s. In the other way, the so-called universal 
probability m is introduced first, and then K(s) is defined as 
— log 2 m(s) without reference to the concept of program-size. In 
this paper, we investigate the properties of the Shannon entropy, 
the power sum, and the Tsallis entropy of a universal probability 
by means of the notion of program-size complexity. We determine 
the convergence or divergence of each of these three quantities, 
and evaluate its degree of randomness if it converges. 

I. Introduction 

Algorithmic information theory is a framework to apply 
information-theoretic and probabilistic ideas to recursive func- 
tion theory. One of the primary concepts of algorithmic 
information theory is the program-size complexity (or Kol- 
mogorov complexity) K(s) of a finite binary string s, which 
is defined as the length of the shortest binary program for the 
universal self-delimiting Turing machine U to output s. By the 
definition, K{s) can be thought of as the information content 
of the individual finite binary string s. In fact, algorithmic 
information theory has precisely the formal properties of 
classical information theory (see Chaitin [2]). The concept of 
program-size complexity plays a crucial role in characterizing 
the randomness of a finite or infinite binary string. 

The program-size complexity K{s) is originally defined 
using the concept of program-size, as stated above. However, it 
is possible to define K(s) without referring to such a concept, 
i.e., we first introduce a universal probability m, and then 
define K(s) as — log 2 m(s). 

In this paper, we investigate the properties of the Shannon 
entropy, the power sum, and the Tsallis entropy of a universal 
probability, from the point of view of algorithmic random- 
ness, by means of the notion of program-size complexity. In 
particular, we show the following: (i) The Shannon entropy 
of any universal probability diverges to infinity, (ii) If q is 
a computable real number with q > 1, then the power sum 
J2 S ni(s) q of any universal probability m has the degree 
of randomness at least 1/q. Here the notion of degree of 
randomness is a stronger notion than compression rate, and 
is defined using the program-size complexity [9], [10]. (iii) If 
< q < 1, then the power sum Y^, s m(s) q diverges to infinity. 



(iv) In the case where q is a computable real number with 
q > 1, the Tsallis entropy S q (m) of a universal probability 
m can have any computable degree of randomness, (v) If 

< q < 1, then the Tsallis entropy S q (m) diverges to infinity. 

II. Preliminaries 

We start with some notation about numbers and strings 
which will be used in this paper. 

N = {0,1,2,3,...} is the set of natural numbers, and 
N + is the set of positive integers. Q is the set of rational 
numbers, and R is the set of real numbers. {0, 1}* = 
{A, 0,1, 00, 01, 10, 11, 000, 001, 010,...} is the set of finite 
binary strings where A denotes the empty string, and {0, 1}* 
is ordered as indicated. We identify any string in {0, 1}* with a 
natural number in this order, i.e., we consider (p: {0, 1}* — > N 
such that (p(s) = Is — 1 where the concatenation Is of strings 

1 and s is regarded as a dyadic integer, and then we identify 
s with (p(s). For any s £ {0, 1}*, \s\ is the length of ,s. A 
subset S of {0, 1}* is called a prefix-free set if no string in S 
is a prefix of another string in S. {0, 1}°° is the set of infinite 
binary strings, where an infinite binary string is infinite to 
the right but finite to the left. For any a £ {0, 1}°° and any 
n £ N + , a n is the prefix of a of length n. For any partial 
function /, the domain of definition of / is denoted by dom /. 
We write "r.e." instead of "recursively enumerable." 

Normally, o(n) denotes any function /: N + — > M such that 
lim JWOO f(n)/n = 0. On the other hand, 0(1) denotes any 
function g: N + — > R such that there is C £ R with the 
property that \g{n)\ < C for all n £ N + . 

Let T be an arbitrary real number. T mod 1 denotes T — 
[T\, where [T\ is the greatest integer less than or equal to 
T. Hence, T mod 1 £ [0, 1). We identify a real number T 
with the infinite binary string a such that O.a is the base-two 
expansion of T mod 1 with infinitely many zeros. Thus, T n 
denotes the first n bits of the base-two expansion of the real 
number T mod 1 with infinitely many zeros. 

We say that a real number T is computable if there exists a 
total recursive function /: N + — > Q such that \T — f{n)\ < 
2~ n for all n £ N + . We say that T is right-computable if 
there exists a total recursive function g: N + — > Q such that 
T < g(n) for all n £ N+ and lim„^ oc ,5(n) = T. We say 
that T is left-computable if — T is right-computable. It is then 
easy to see that, for any T £ K, T is computable if and 
only if T is both right-computable and left-computable. See 



e.g. Pour-El and Richards [6] and Weihrauch [14] for the detail 
of the treatment of the computability of real numbers and real 
functions on a discrete set. 

A. Algorithmic information theory 

In the following we concisely review some definitions and 
results of algorithmic information theory [2], [3], [4]. A 
computer is a partial recursive function C : {0, 1}* — > {0, 1}* 
such that domC is a prefix-free set. For each computer 
C and each s G {0,1}*, K c (s) is defined by K c (s) = 
min { \p\ | p G {0, 1}* & C(p) — s }. A computer U is said 
to be optimal if for each computer C there exists a constant 
sim(C) with the following property; if C(p) is defined, then 
there is a p' for which U(p') = C(p) and \p'\ < \p\ +sim(C). 
It is easy to see that there exists an optimal computer. Note that 
the class of optimal computers equals to the class of functions 
which are computed by universal self-delimiting Turing ma- 
chines (see [2] for the detail). We choose a particular optimal 
computer U as the standard one for use, and define K(s) as 
Ku(s), which is referred to as the program-size complexity of 
s, the information content of s, or the Kolmogorov complexity 
of s. Thus, K(s) < Kc(s) + sim(C) for any computer C. 

The program-size complexity K(s) is originally defined 
using the concept of program-size, as stated above. However, 
it is possible to define K(s) without referring to such a 
concept, i.e., as in the following, we first introduce a universal 
probability m, and then define K(s) as — log 2 m(s). We say 
that r is a semi-measure on {0, 1}* if r: {0, 1}* — > [0, 1] such 
that X)se{o i}* r ( s ) < 1- A universal probability is defined as 
follows [15]. 

Definition 1 (universal probability) We say that r is a 
lower- computable semi-measure if r is a semi-measure 
on {0, 1}* and there exists a total recursive function 
f: N+ x {0,1}* -> Q such that, for each s G {0,1}*, 
lirrin^oo f(n,s) = r(s) and Vn 6 N + < f(n,s) < r(s). 
We say that a lower-computable semi-measure m is a universal 
probability if for any lower-computable semi-measure r, there 
exists a real number c > such that, for all s G {0, 1}*, 
cr(s) < m(s). ■ 

The following theorem can be then shown (see e.g. Theorem 
3.4 of Chaitin [2] for its proof). Here, P(s) is defined as 



E 



U(p)=s ■ 



for each s G {0, 1}" 



Theorem 2 Both 2~ K ^ and P{s) are universal 
probabilities. 



By Theorem [2] we see that, for any universal probability 



m, 



K(s) = -log 2 m(s) + 0(l). 



(1) 



Thus it is possible to define K(s) as — log 2 m(s) with a 
particular universal probability m instead of as Kjj(s). Note 
that the difference up to an additive constant is nonessential 
to algorithmic information theory. Any universal probability 
is not computable, as corresponds to the uncomputability of 



K(s). As a result, we see that < E s e{o i}* m i s ) < 1 f° r 
any universal probability m. 

For any a G {0, 1}°°, we say that a is weakly Chaitin 
random if there exists c G N such that, for all n G N + , n — c < 
K(a n ) [2], [4]. As the total sum of the universal probability 
2~ K ( S \ Chaitin [3] introduced the real number 9 by 

2 -K(o)_ 



E 

se{o,i}* 



(2) 



Then [3] showed that is weakly Chaitin random. 

In the works [9], [10], we generalized the notion of the 
randomness of an infinite binary string so that the degree of 
the randomness can be characterized by a real number D with 
< D < 1 as follows. 

Definition 3 (weakly Chaitin D-random) Let D G K with 
D > 0, and let a G {0, 1}°°. We say that a is weakly Chaitin 
D-random if there exists c G N such that, for all n G N + , 
Dn-c< K(a n ). ■ 

Definition 4 (D-compressible) Let OeM with D > 0, and 
let a G {0, 1}°°. We say that a is D -compressible if K{ct n ) < 
Dn + o(n), which is equivalent to lirrin^oo K(a n )/n < D. ■ 

In the case of D = 1, the weak Chaitin Z?-randomness 
results in the weak Chaitin randomness. For any D G [0, 1] 
and any a G {0, 1}°°, if a is weakly Chaitin D-random and 
D-compressible, then 

K(a. N 



lim 



= A 



(3) 



and therefore the compression rate of a by the program-size 
complexity K is equal to D. Note, however, that (O does not 
necessarily implies that a is weakly Chaitin D-random. 
In the work [10], we generalized 9 to 9 D by 



E 

se{o,i}* 



(D > 0). 



(4) 



Thus, 6 = 6 1 . If < D < 1, then 9 D converges and < 
9 D < 1, since 9 D < 9 < 1. Theorem \5\ below was mentioned 
in Remark 3.2 of Tadaki [10]. 

Theorem 5 (Tadaki [10]) Let Cel. 

(i) If < D < 1 and D is computable, then 9 D is weakly 
Chaitin D-random. 

(ii) If < D < 1 and D is computable, then 9 D is D- 
compressible. 

(iii) If \ < D, then 9 D diverges to oo. ■ 
III. The Shannon entropy of a universal 

PROBABILITY 

We say that p — (pi, . . . ,p n ) is a probability distribution if 
Pi G [0, 1] for alii = 1, . . . , n and p\ + ■ ■ ■ + p n = 1. For any 
probability distribution p = . . . ,p n ), the Shannon entropy 
H(p) of p is defined by 



H (P) = -E PllnPi ' 



(5) 



i=l 



where the In denotes the natural logarithm [7]. We say that 
p = (pi,...,p n ) is a semi-probability distribution if pi £ 
[0, 1] for all i = 1, .... n and pi + ■ ■ ■ + p n < 1. We 
define the Shannon entropy H (p) also for any semi -probability 
distribution p = (pi, . . . ,p n ) by ©. Moreover, for any semi- 
measure r on {0, 1}*, we define the Shannon entropy H(r) 
of r by 

H(r) = — r(s) In r(s) 

se{o,i}* 

in a similar manner to ([5]). 

In this section, we prove that the Shannon entropy H(m) 
of an arbitrary universal probability m diverges to oo. For 
convenience, however, we first prove the following more 
general theorem, Theorem [6j from which the result follows. 
For example, Theorem [6] itself can be used to determine 
the properties of the notions of thermodynamic quantities 
introduced by Tadaki [12] into algorithmic information theory. 

Theorem 6 Let A be an infinite r.e. subset of {0,1}* and 
let / : N + — * N be a total recursive function such that 
lim^^oo f(n) = oo. Then the following hold. 

(i) T,u(p)eAf(\p\) 2 ~ M diverges to oo. 

(ii) If there exists Iq £ N + such that f(l)2~ l is a 
nonincreasing function of I for all I > Iq, then 
J2seAf( K ( s )) 2 ~ K{s) diverges to oo. 

Proof: (i) Contrarily, assume that YluMeA f(\p\) 2 
converges. Then, there exists d £ N + such that 

T,u(p)eA.f(\p\) 2 ^ pl < d - We deflne the function 
r: {0,1}* -> [0,oo) by 

r ( s ) = ^ E /(bl) 2_|p| 

U(p)=s 

if s £ A; r(s) = otherwise. We then see that 
Ssg{o i}* r ( s ) — ^ an d therefore r is a lower-computable 
semi-measure. Since P(s) is a universal probability by The- 
orem 12 there exists c £ N + such that r(s) < cP(s) for all 
s £ {0, 1}*. Hence we have 

£ (cd-/(H))2-H>0 (6) 

U{p)=s 

for all s £ A. On the other hand, since A is an infinite set and 
limn—xx, f(n) = oo, there is so £ A such that f(\p\) > cd 
for all p with U(p) — sq- Therefore we have J2u(p)=s ( c d ~ 
/(|p|))2~l p l < 0. However, this contradicts (|5), and the proof 
of (i) is completed. 

(ii) We first note that there is no £ N such that K{s) > Iq 
for all s with \s\ > no. Now, let us assume contrarily that 
^2seA f(-K( s )) 2 converges. Then, there exists d £ N + 
such that J2 s eAf( K ( s )) 2 ~ Kis) ^ d - We define the function 
r: {0,1}* -> [0,oo) by 

r(s) = ±f(K( s ))2- K ^ 

if s £ A and |s| > no; r(s) = otherwise. We then see that 
Ssg{o i}* r ( s ) — 1 and therefore r is a lower-computable 



semi-measure. Since 2^ K ^ is a universal probability by 
Theorem |2j there exists c £ N + such that r(s) < c2^ K ^ 
for all s £ {0,1}*. Hence, if s £ A and |s| > no, then 
erf > f(K( s ))- On the other hand, since ^4 is an infinite set 
and linin^oo f(n) = oo, there is so £ A such that |so| > no 
and f(K(s j) > cd. Thus, we have a contradiction, and the 
proof of (ii) is completed. ■ 

From Theorem [6] (ii), we obtain the following result, as 
desired. 

Corollary 7 Let m be a universal probability. Then the Shan- 
non entropy H(m) of m diverges to oo. 

Proof: We first note that there is a real number xo > 
such that the function x2~ x of a real number x is decreasing 
for x > xq. For this xq, there is no £ N such that 
— log 2 m(s) > xq for all s with \s\ > uq. On the other hand, 
by (UK there is c £ N such that — log 2 m(s) < K(s) + c for 
all s £ {0, 1}*. Thus, we see that 

— m(s) log 2 m(s) 

«6{0,i}* & H>n 

> Yl {K{s) + c)2- K{s) ~ c 

s e{o,i}* & | s |>™ ^ 

= 2~ c K{s)2- K ^ 

sS{0,l}* & |s|>n 

+ c2" c 2 ~ K{S) - 

se{0,l}* & |s|>rao 

Using Theorem |6](ii) with A = {0, 1}* and f(n) = n, we see 
that X)se{o,i}* K{s)2^ K ^ diverges to oo. It follows from 
(fTJl that — X) se ^o i}* m ( s ) 1°S2 m ( s ) a l so diverges to oo. This 
completes the proof. ■ 

IV. The power sum of a universal probability 
In this section, we investigate the convergence or divergence 
of the power sum X)sg{o i}* m { s ) 9 °f a universal probability 
m, and evaluate its degree of randomness if it converges, 
by means of the notions of the weak Chaitin D-randomness 
and the _D-compressibility. We first consider the notion of the 
weak Chaitin D-randomness of the power sum of a universal 
probability. We can generalize Theorem [5] (i) and (iii) on 
the specific universal probability 2~ K ^ over an arbitrary 
universal probability as follows. 

Theorem 8 Let m be a universal probability, and let q £ R. 

(i) If Q ^ 1 an d q is a right-computable real number, then 
Ese{o l}* m { s ) q converges to a left- computable real 
number which is weakly Chaitin 1 / q-random. 

(ii) IfO < q < 1, then J2se{o i}» m i s ) q diverges to oo. ■ 

Theorem [8] (i) shows that, for any q £ R with q > 1, 
the right-computability of q results in the weak Chaitin 1/q- 
randomness of the power sum X) s e{o i}» m ( s ) q of a universal 
probability m. On the other hand, Theorem |9]below shows that 



the converse in a certain sense holds. Theorem|9]can be proved 
based on the techniques used in the proof of the fixed point 
theorem on compression rate [12]. 

Theorem 9 Let m be a universal probability, and let q G R 
with q > 1. If X)se{o l}* m ( s ) q i s a right-computable real 
number, then q is weakly Chaitin \/q-random. ■ 

Next, we consider the notion of the D-compressibility of the 
power sum of a universal probability. Theorem [5] (ii) shows 
that, for the specific universal probability m(s) = 2~ K ( S \ 
if q is a computable real number with q > 1, then the 
power sum X) s e{o i}* m { s ) q is 1/q-compressible. Thus, the 
following question naturally arises: Is X) s e{o i}* m i s ) q a l/<7~ 
compressible real number for any universal probability to and 
any computable real number q > 1 ? As shown in Theorem 
[TOl however, we can answer this question negatively. 

Theorem 10 There exists a universal probability m such that, 
for every computable real number q > 1, X)se{o i}» m ( s ) q is 
weakly Chaitin random and therefore not 1 / q-compressible. 

Proof: We choose any one universal probability r, and 
then choose any one c 6 N with 2~ c # < r(A), where is 
defined by ©. We define the function to: {0,1}* — > [0,oo) 
by m(s) = 2~ c 6' if s = A; m(s) = r(s) otherwise. 

Since X) se {o.i}* r ( s ) - 1 > il f°ll° ws tnat X^e{o,i}* to ( s ) - 
1. Therefore, since 9 is left-computable and r is a lower- 
computable semi-measure, we see that to is a lower- 
computable semi-measure. Note that dr(s) < m(s) for all 
s G {0, 1}*, where d = 2~ c 9/r{\) > 0. Thus, since r is a 
universal probability, m is also a universal probability. 

On the other hand, since 6 is weakly Chaitin random, to(A) 
is also weakly Chaitin random. Let q be an arbitrary com- 
putable real number with q > 1. Then, since q is a computable 
real number with q ^ 0, it follows that K((a q ) n ) = K(a n ) + 
0(1) for any real number a > 0. Thus, K((m(\) q ) n ) = 
K((m(\)) n ) + 0(1) and therefore m(X) q is weakly Chaitin 
random. Note that K(a n ) < K((a + b) n ) + 0(1) for any 
left-computable real numbers a, b. This can be proved using 
the condition 2 of Lemma 4.4 and Theorem 4.9 of [1]. Thus, 
since m(\) q and J2 s ^x rn ( s ) q 316 left-computable, we see that 
Ssg{o i}* m ( s ) q is weakly Chaitin random. It follows from 
q > 1 that X)se{o i}* m ( s ) q is not 1/g-compressible. ■ 

V. The Tsallis entropy of a universal probability 

The notion of Tsallis entropy has been introduced by Tsallis 
[13]. Let q be a positive real number with g / 1. For any 
probability distribution p = (pi, . . . ,p n ), the Tsallis entropy 
S q (p) of p is defined by 

S q (v) - ~ Z ^ lPt - (8) 
q-1 

When q — * 1, the Tsallis entropy recovers the Shannon entropy 
for any probability distribution. See [13], [5] for the detail of 
the theory and applications of Tsallis entropy. 



We generalize the definition ([H} for any semi-probability 
distribution p = (p%, . . . ,p n ) by 

Sq (p) = Skig^Ml , (9) 

In fact, we see that, for any semi-probability distribution p, 
lirriq^i S q (p) = H(p), and therefore this generalization (0 
is consistent with the Shannon entropy for a semi-probability 
distribution, defined in Section|]ll] Thus, we define the Tsallis 
entropy S q (r) of any semi-measure r on {0, 1}* by 

S q (r) = -^- J2 Ms)-r( S ) q } 

9 s6{0,l}* 

in a similar manner to (0. 

In what follows, we investigate the convergence or diver- 
gence of the Tsallis entropy S q (m) of a universal probability 
to, and evaluate its degree of randomness if it converges, in 
the same manner as the previous section. We first investigate 
the convergence and divergence of S q (m) as follows. 

Theorem 11 Let m be a universal probability, and let q £ KL 

(i) If q > 1, then S q (m) converges. 

(ii) If < q < 1, then S q (m) diverges to oo. 

Proof: Theorem QT| follows immediately from Theorem 
i ■ 

Theorem[T2]below shows that, if the total sum of a universal 
probability to is small, then the Tsallis entropy of to has to be 
maximally random with respect to the degree of randomness. 

Theorem 12 Let to be a universal probability, and let q be 
a computable real number with q > 1. If m(s) < q 1 ^ for 
all s £ {0,1}*, then S q (m) is left-computable and weakly 
Chaitin random. 

Proof: By Theorem QT| (i), there is d G N + such that 
S q (m) < d. We define r: {0,1}* -> (0,oo) by r(s) = 
F(m(s))/d, where F: (0,1] -» [0, oo) with F(x) = (x - 
x q )/(q — 1). We show that r is a universal probability. 

Obviously, X)se{o i}* r ( s ) — Since m is a lower- 
computable semi-measure, there exists a total recursive func- 
tion /: N+ x {0, 1}* -> Q such that, for each s € {0, 1}*, 
lirrin^oo f(n, s) = m(s) and Vn G N + < f(n, s) < m(s). 
Since F(x) is continuous and increasing for all x G (0, q 1 ^ ], 
it follows that, for each s G {0,1}*, lim^oo F(f(n, s)) = 
F(m(s)) and Vn G N+ < F(f(n,s)) < F(m(s)). On the 
other hand, since q is computable, there exists a total recursive 
function g: N+ x {0, 1}* — » Q n [0, oo) such that, for each 
s G {0, 1}* and each n G N+, 

F(f(n, S ))-2- n <g(n, S )<F(f(n,s)). 

Hence, r is a lower-computable semi-measure. Note that 
x/q < F(x) for all x G (0, q~\. It follows that m(s)/(qd) < 
r(s) for all s G {0, 1}*. Thus, since to is a universal 
probability, r is also a universal probability. 



It follows from Theorem [8] (i) that 



sG{0,l}* 



is) 



S q (m)/d is weakly Chaitin random. Note that K(a n ) < 
K((ab) n ) +0(1) for any left-computable real numbers a,b > 
0. This can be proved using the condition 4 of Lemma 4.4 
and Theorem 4.9 of [1]. Thus, since X)se{o i}* r ( s ) anc ^ ^ are 
left-computable positive real numbers, we see that S q (m) is 
weakly Chaitin random and, obviously, left-computable. ■ 

Based on Theorem Q~2] we can show a stronger result 
than Theorem Q~2] with respect to the range of the degree of 
randomness of the Tsallis entropy S q {m). Theorem [T3l and 
Corollary [l4]below show that the Tsallis entropy of a universal 
probability can have any computable degree of randomness 
D. Note, however, that Theorem Q~3] is not a generalization 
of Theorem [12] The reason is as follows: The Tsallis entropy 
S q (m) is right-computable in Theorem [13] whereas it is not 
right-computable in Theorem [T2l 

Theorem 13 Let q be a computable real number with q > 1. 
Then, for any right-computable real number y £ (0, q 1 -*], 
there exists a universal probability m such that S q (m) = y. 

Proof: Let F : (0,1] -> [0, oo) with F(x) = (x - 
x q )/(q — 1), and let Xq be the unique real number such that 
q T ^ < xo < 1 and F(xq) = y/2. We choose any one rational 
number c such that < c < mmlq 1 ^ , 1— xq, (q—\)y/2}. We 
also choose any one universal probability r. We then define a 
universal probability r\ : {0,1}* — » (0,1) by r\(s) = cr(s). 
Since ri(s) < q 1 ^ for all s £ {0,1}*, it follows from 
Theorem [T2l that S q (ri) is left-computable. 

Let = S q (ri). From X) s e{o i}* r ( s ) < 1 we have 
E se {o,i}* r i( s ) ^ c - Therefore, 

F(r 1 ( S ))< r l T J2 r ^ 3 ^ 



e = 



X, ... i 

sG{0,l}* sG{0,l}* 



1 



Since c/(q — 1) < y/2, it follows that y/2 < y - 6 < y. 
Note that F(x) is continuous and decreasing for all x £ 

1 1 q 

[q 1 -'' Thus, since F(g!-<!) = g 1 -? > y and y/2 > 
F(l) = 0, there exists the unique real number a such that 
q 1 ^ < a < xq and F(a) = y — 8. We see that a is left- 
computable. This is because y — O is right-computable, g is 
computable, and F(x) is decreasing for all x £ (q TTr ^,Xo). 

We define the function m: {0, 1}* — > (0, oo) by m(s) = a 
if s = A; m(s) = ri(s — 1) otherwise. Note here that {0, 1}* 
is identified with N. Then, it follows from c < 1 — xq and 
a < xq that X)se{o i}* m ( s ) < !• Thus, since n is a lower- 
computable semi-measure and a is left-computable, we see 
that in is a lower-computable semi-measure. Since r\ is a 
universal probability and a > 0, we further see that m is a 
universal probability. On the other hand, S q (m) = F(a) + 
Sq( r i) — F( a ) + 9 = 2A This completes the proof. ■ 

Corollary 14 Lef q be a computable real number with q > 1. 
77;en, /or any computable real number D £ [0, 1], there exists 
a universal probability m such that S q (m) is weakly Chaitin 
D-random and D -compressible. 



Proof: In the case of D = 0, consider a rational number 
y £ (0, q 1 ^} in Theorem [T3l In the case of D > 0, consider 
y = a(l — 9 D ) in Theorem [T3l where a is any one rational 
number with a £ (0, g 1 "^] and is defined by @. In this 
case, the result follows from Theorem [5] (i) and (ii). ■ 

VI. Conclusion 

In this paper, we have investigated the properties of the 
Shannon entropy, the power sum, and the Tsallis entropy of 
a universal probability, from the point of view of algorithmic 
randomness. Future work may aim at generalizing Reny en- 
tropy over a universal probability properly and investigating 
its randomness properties. 
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